Audio-Visual, Visuo-Tactile and Audio-Tactile Correspondences in Preschoolers

Differentiated audio-tactile correspondences in sighted and blind individuals.

The aim of the present study is to investigate whether the crossmodal correspondence robustly documented between auditory pitch and visual elevation has analogues in the audio-tactile domain. Across 4 experiments, the compatibility effects between intuitively congruent pairs of stimuli (i.e., outward tactile movement, going from the inside of the finger toward the fingertip and increasing pitch...

A Tactile Audio Visual Instrument using Sound Source Localisation

This paper presents a new musical interface design, with which any hard, flat surface can become a musical controller. Furthermore, dynamic graphics are produced simultaneously by the interface to provide the user with a visual representation of the sound. Using an equally spaced grid of piezos to capture a sound source, the difference between the arrivals of the sound to each piezos can be cal...

BATS: The Blind Audio Tactile Mapping System

The BATS project focuses on helping students with visual impairments access and explore spatial information using standard computer hardware and open source software. Our work is largely based on prior techniques used in presenting maps to the blind such as text-to-speech synthesis, auditory icons, and tactile feedback. We add spatial sound to position auditory icons and speech callouts in thre...

Multimodal Ternus: visual, tactile, and visuo-tactile grouping in apparent motion.

Gestalt rules that describe how visual stimuli are grouped also apply to sounds, but it is unknown if the Gestalt rules also apply to tactile or uniquely multimodal stimuli. To investigate these rules, we used lights, touches, and a combination of lights and touches, arranged in a classic Ternus configuration. Three stimuli (A, B, C) were arranged in a row across three fingers. A and B were pre...

Designing with and for people living with visual impairments: audio-tactile mock-ups, audio diaries and participatory prototyping